Address-event Matching for a Silicon Retina Based Stereo Vision System
نویسندگان
چکیده
In this paper we present a stereo vision system based on silicon retina sensors. Derived from the human vision system, these bio-inspired silicon retina sensors are a new type of imagers. Conventional optical sensors capture images at a fixed frame-rate and deliver pixel information of the sensor chip at a certain point in time. In contrast, a silicon retina optical sensor provides only intensity variations (events) in the visual field. The target application of the silicon retina sensor in this work is a stereo vision system for pre-crash/side impact detection. Regarding the asynchronous event-triggered output characteristic of the silicon retina new approaches for data acquisition and processing of the data are necessary. In a first step data from the silicon retina imagers are converted into frames and processed with frame-based stereo vision algorithms. These methods do not benefit from the advantages of the silicon retina technology, thus a new approach exploiting the novelty of the sensor was implemented. This stereo matching approach uses the time information of the delivered address events as a primary matching criterion to find corresponding pixels in the data stream of the left and right sensor. The event-based stereo matching approach is tested with synthetic data, where also an evaluation with ground truth is carried out.
منابع مشابه
Bio-inspired Stereo Vision System with Silicon Retina Imagers
This paper presents a silicon retina-based stereo vision system, which is used for a pre-crash warning application for side impacts. We use silicon retina imagers for this task, because the advantages of the camera, derived from the human vision system, are high temporal resolution up to 1ms and the handling of various lighting conditions with a dynamic range of ∼120dB. A silicon retina deliver...
متن کاملLow-level Stereo Matching using Event-based Silicon Retinas
This semester thesis examines the task of computing stereo image disparities using a binocular pair of event-based silicon retinas [1]. Unlike conventional video cameras, this silicon retina is asynchronous and event-based. It responds to reflectance change and thus the events primarily encode object movement. Therefore there is no global frame rate. Two different algorithms were devised to do ...
متن کاملStereo-Vision Algorithm Based on Bio-Inspired Silicon Retinas for Implementation in Hardware
In this paper, we propose a silicon-retina-based stereo vision system, used for pre-crash warning or rather side-impact detection applications in vehicles. The bio-inspired silicon retina sensor is a new kind of sensor, which delivers data asynchronously and only if the intensity of the ambient light changes. Therefore, the amount of data that must be processed decreases significantly compared ...
متن کاملNeuromorphic computer vision: overcoming 3D limitations
Asynchronous, event-based artificial retinas1 are introducing a shift in current methods of tackling visual signal processing.2–4 Conventional frame-based image acquisition and processing technologies are not designed to take full advantage of the dynamic characteristics of visual scenes. A collection of snapshots is static and contains much redundant information. That is because every pixel is...
متن کاملIllumination-Invariant Face Recognition with a Contrast Sensitive Silicon Retina
Changes in lighting conditions strongly effect the performance and reliability of computer vision systems. We report face recognition results under drastically changing lighting conditions for a computer vision system which concurrently uses a contrast sensitive silicon retina and a conventional, gain controlled CCO camera. For both input devices the face recognition system employs an elastic m...
متن کامل